Vietnamese multimodal social affects: how prosodic attitudes can be recognized and confused
نویسندگان
چکیده
Social affective expression is a main part of face-to-face interaction and it is highly linked to the language through the culture. This paper presents a study on Audio-Visual prosodic attitudes in Vietnamese, an under-resourced tonal language. Based on an audio-visual corpus of 16 attitudes, perception experiments were carried out with Vietnamese and French participants. The result analysis shows the relative contribution of audio, visual, and audio-visual information in attitude perception. It also shows how native and non-native listeners recognize and confuse the attitudes, thus allows us to investigate the cultural specificities and cross-cultural common attitudes in Vietnamese.
منابع مشابه
Cross-cultural perception of Vietnamese Audio-Visual prosodic attitudes
Prosodic attitudes (social affects) are highly linked to the language through the culture, and are a main part of face to face interaction. Therefore, for description and modeling, as well as for applications like translation, language learning or synthesis, a cross-cultural approach is relevant. This paper presents a cross-perception of Audio-Visual prosodic attitudes in Vietnamese, an under-r...
متن کاملLocal vs . Global Prosodic Cues : Effect of Tones on Attitudinal Prosody in Cross - Perception of Vietnamese
Attitudes or social affects are strongly implied in interaction processing, and specifically to socio-cultural aspects of language. In face-to-face interaction, social affects are expressed through global patterns of prosody. This paper presents a cross-perceptual study of social affects in Vietnamese, a tonal language. Sixteen Vietnamese attitudes with tonal variation were used in a perception...
متن کاملModeling the prosody of Vietnamese attitudes for expressive speech synthesis
Attitudes or social affects are strongly implied in interaction processing, and specifically to socio-cultural aspects of language. This paper presents the modeling of attitude to apply in expressive speech synthesis in Vietnamese, an under-resourced tonal language. A prosodic model for Vietnamese attitude is proposed based on the concept of “rendez-vous” between linguistic levels and prosodic ...
متن کاملTonal Influences on the Prosodic Cross-linguistic Perception of Mandarin Social Affects by French and Vietnamese listeners
Social affects play an important role in the face-to-face interaction and are implied in the realization of speech acts. The prosody is a main vector of social affects and its crosslanguage variability is a challenge for language description as well as for foreign language teaching. The present paper aims at examining the influences of tones on the perception of 19 prosodic social affects of Ma...
متن کاملAudio-visual prosody of social attitudes in vietnamese: building and evaluating a tones balanced corpus
This paper presents the building and a first evaluation of a tones balanced Audio-Visual corpus of social affect in Vietnamese language. This under-resourced tonal language has specific glottalization and co-articulation phenomena, for which interactions with attitudes prosody are a very interesting issue. A well-controlled recording methodology was designed to build a large representative audi...
متن کامل